Dynamic Gesture Controlled User Interface Expert HCI System using Adaptative Background Masking: An Aid to Prevent Cross Infections
Published: August 1, 2020 | DOI: https://doi.org/10.7860/JCDR/2020/45065.13961
Seema Rawat, Praveen Kumar, Ishita Singh, Shourya Banerjee, Shabana Urooj, Fadwa Alrowais
1. Associate Professor, Department of Information Technology, Amity University, Gautam Budh Nagar, Sector-125, Noida, Uttar Pradesh, India.
2. Associate Professor, Department of Computer Science Engineering, Amity University,Tashkent, Uzbekistan. (On deputation from Amity University Noida, UP, India)
3. Scholar, Department of Computer Science Engineering, Amity University, Gautam Budh Nagar, Sector-125, Noida, Uttar Pradesh, India.
4. Scholar, Department of Computer Science Engineering, Amity University, Gautam Budh Nagar, Sector-125, Noida, Uttar Pradesh, India.
5. Associate Professor, Department of Electrical Engineering, College of Engineering, Princess Nourah Bint Abdulrahman University, Riyadh, Saudi Arabia (On leave from
Gautam Buddha University, Uttar Pradesh, India).
6. Assistant Professor, Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, Riyad, Saudi Arabia.
Correspondence
Fadwa Alrowais,
Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, Airport Road, Riyad PO 84428, Kingdom of Saudi Arabia.
E-mail: fmalworais@pnu.edu.sa
Human-Computer Interaction (HCI) interfaces need unambiguous instructions in the form of mouse clicks or keyboard taps from the user and thus gets complex. To simplify this monotonous task, a real-time hand gesture recognition method using computer vision, image, and video processing techniques has been proposed. Controlling infections has turned out to be the major concern of the healthcare environment. Several input devices such as keyboards, mouse, touch screens can be considered as a breeding ground for various micro pathogens and bacteria. Direct use of hands as an input device is an innovative method for providing natural HCI ensuring minimal physical contact with the devices i.e., less transmission of bacteria and thus can prevent cross infections. Convolutional Neural Network (CNN) has been used for object detection and classification. CNN architecture for 3d object recognition has been proposed which consists of two models: 1) A detector, a CNN architecture for detection of gestures; and 2) A classifier, a CNN for classification of the detected gestures. By using dynamic hand gesture recognition to interact with the system, the interactions can be increased with the help of multidimensional use of hand gestures as compared to other input methods. The dynamic hand gesture recognition method focuses to replace the mouse for interaction with the virtual objects. This work centralises the efforts of implementing a method that employs computer vision algorithms and gesture recognition techniques for developing a low-cost interface device for interacting with objects in the virtual environment such as screens using hand gestures.
[
FULL TEXT ] | [ PDF]